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© Method and system for improving the processing time of the path selection in a high speed packet 
switching network. 



© The routing paths between origin and destination nodes in a packet switching network are selected more 
efficiently by reducing the total number of links potentially visited by the routing algorithm. The path selection 
technique involves two phases, the first phase for principal links identification, and the second phase for 
selection of the best point-to-point path in the network. Principal paths are minimum hop count paths with a 
transmission delay less than a specified threshold. The algorithm limits the screening of the network links in the 
second phase to the principal links and excludes the secondary links. The exploration of a much smaller number 
of links has the advantage to considerably reduce the computation time required for the path selection. The fact 
the number of principal links is generally small compared with the total number of links potentially explored, 
allows to limit the additional processing time necessary in case of unsuccessful attempt. 
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Technical field 

The present invention relates to a high speed transmission system in a large packet switching network 
and, more particularly, to an apparatus and a method for accelerating the path selection between a source 
5 and a destination node by reducing the total number of links potentially explored by the Modified Bellman- 
Ford Algorithm. 

Background art 

10 It has become increasingly useful to interconnect a plurality of data processing elements by means of a 
packet switching network in which data is transmitted as data assemblages called "packets". Such networks 
include a plurality of interconnected switching nodes which, in turn, are connected to end nodes supporting 
data processing equipments. Such packet networks can become quite large with an extensive geographical 
distribution. In such a situation, the selection of an efficient path between two end nodes which wish to 

rs communicate with each other becomes of paramount importance. Different methods are summarized by H. 
Nussbaumer in Teleinformatique II (pages 92 to 117) Presses Polytechniques Romandes 1987. 

Path Selection 

20 The general problem which must be solved at the network level is to find a path between a source and 
a destination node. When the network is using datagrams, the path selection must be done individually for 
each packet. For virtual circuits, the path decision is done once only at the time of the circuit establishment. 
In both cases, the choice of a routing algorithm is not easy because it must satisfy a large number of often 
conflicting requirements. This algorithm must be simple to implement to not complicate the nodes 

25 realization, it must ensure a correct progress of the packets whatever the disturbance on the network. The 
algorithm must be able to provide satisfying results despite of the traffic variations and the network 
topology. It must also ensure the equity between the different end users and provide an equal distribution of 
the rights to access the network. At last, the routing algorithm must allow, when possible, to exploit the 
network in an optimal way, according to a criterion which can vary with the utilization type. In most of the 

30 cases, the network is realized in a way to minimize the packet transit time and to transfer the maximum 
number of packets. In other cases, the objective is to decrease the communication cost, or to develop a 
reliable network able to operate correctly either in case of catastrophic line, node failure or peaks of traffic. 

Because of the variety of the constraints, there are a large number of different routing types like 
Floading Routing, Random or Stochastic Routing, Deterministic Routing. This last technique is one of the 

35 most widely used. Two modes of operation are opposed : the Fixed Routing and the Adaptive Routing. 

Fixed Routing 

The Fixed Routing defines paths that must take the different packets according to the general network 
40 characteristics such as the network topology and the mean traffic expected on the communication lines. 
The routing rules are established once and aims for optimizing the performance criterion privileged by the 
user. The Fixed Routing is very simple in its principles and allows to considerably speed up the packet 
transmission through the network. 

45 Adaptive Routing 

Contrary to the Fixed Routing, the purpose of the Adaptive Routing is to satisfy at any time the 
optimization criterion. The tables are permanently updated according to, for example, the instantaneous 
state of the traffic on the lines, 
so • Centralized Routing 

When the characteristics of the network fluctuate, it is possible to adapt the routing by assigning 
to one node the responsibility to update periodically the routing tables according to the traffic 
variations and the topology. This method, simple in its principles, is called Centralized Routing. Its 
principal disadvantage is to generate an important auxiliary traffic and to subordinate the good 
55 functioning of the network to only one node. Furthermore, the Centralized Routing can generate some 

problems at the time the tables are refreshed because said tables cannot be received at the same 
time by all the nodes. A solution is to decentralize the tables establishment at the level of each node. 
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• Local Routing 

The local and distributed routing methods are both based on the establishment by each node of 
its own routing table according to information locally collected- In its most simple form, the method 
consists in placing the packet just received in the shorter output queue and in transmitting it as 
5 rapidly as possible. The local algorithm tends in its principle to circulate the packets very quickly in 

the network. However as the routes are selected in some way or other the mean paths length is far to 
be minimal. 

• Distributed Routing 

The Distributed Routing is a local method in which neighboring nodes are exchanging messages 
io concerning the traffic and the network condition to update their routing and delay tables. 

High Performance Networks 

The data transmission is now evolving with a specific focus on applications and by integrating a 
75 fundamental shift in the customer traffic profile. Driven by the growth of workstations, the local area 
networks (LAN) interconnection, the distributed processing between workstations and super computers, the 
new applications and the integration of various and often conflicting structures - hierarchical versus peer to 
peer, wide (WAN) versus local (LAN) area networks, voice versus data - the data profile has become higher 
in bandwidth, bursting, non deterministic and requires more connectivity. Based on the above, it is clear that 
20 there is strong requirement for supporting distributed computing applications across high speed networks 
that can carry LAN communications, voice, video, and traffic among channel attached hosts, business, 
engineering workstations, terminals, and small to intermediate file servers. This vision of a high speed 
multiprotocol network is the driver for the emergence of fast packet switching networks architectures in 
which data, voice, and video information is digitally encoded, chopped into small packets and transmitted 
25 through a common set of nodes and links. 

Throughput 

The key requirement of these new architectures is to reduce the end-to-end delay in order to satisfy 
30 real time delivery constraints and to achieve the necessary high nodal throughput for the transport of voice 
and video. Increases in link speeds have not been matched by proportionate increases in the processing 
speeds of communication nodes and the fundamental challenge for high speed networks is to minimize the 
packet processing time within each node. 

For example (Figure 1), taking a node with an effective processing rate of 1 MIPS (Millions of 
35 Instructions Per Second), it is possible to fill a 9.6 kbps line with 1000 byte packets even if a network node 
must execute 833 000 instructions per packet processed. For a 64 kbps line the node can afford 125 000 
instructions per packet. In order to fill an OC24 link, however, our 1 MIPS node could only execute 7 
instructions per packet. In the latter case even an effective rate of 10-30 MIPS would allow only 70-200 
instructions per packet. 

40 In order to minimize the processing time and to take full advantage of the high speed/low error rate 
technologies, most of the transport and control functions provided by the new high bandwidth network 
architectures are performed on an end-to-end basis. 

Routing Modes 

45 

The routing within the network presents two aspects : 

1. Determining what the route for a given connection shall be, 

2. Actually switching the packet within a switching node. 

There are many methods of determining a route through a network. For very high throughput, the 
so critical item is that the switching elements must be able to decide where to route an incoming packet in a 
very short portion of time. As described in the document High Speed Networking Technology, An 
Introductory Survey (pages 88 to 96) - GG24- 3816- 00 ITSC Raleigh March 1992, the routing modes 
the most widely used are the Source Routing and the Label Swapping. 

• Source Routing 

55 The Source Routing is a particular implementation of the Distributed Routing for connectionless 

networks. The source node (or access node) is responsible for calculating the route the packet must 
take through the network. A routing field is appended to every packet sent and that field is used by 
the intermediate nodes to direct the packet towards its destination, of a path. Each packet is routed 
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through the network as a self contained unit and is independent of all other packets. The key point for 
the source node is to determine for each datagram the optimal route in the shorter lapse of time. 

• Label Swapping 

The Label Swapping is a particular implementation of the Distributed Routing for connection 
5 oriented networks. These networks typically multiplex many connections (or sessions) on a link using 

some form of logical "channel". Each packet sent on the link has a header which includes an arbitrary 
number identifying which logical connection that this packet belongs to. 

The call set up and the resource reservation process comprises the following steps : 

■ A connection request is specified by the user via a set of parameters including origin and 
w destination address and data flow characteristics. 

■ The path determination is realized by the source node from its local routing Topology Database 
a The route reservation is sent out in a special message along the specified nodes. Said message, 

which is usually routed according to the previously described Source Routing technique, signals 
the nodes to set up their connection tables and to reserve their resources to provide the level of 
is service required by the traffic type (for example, a bandwidth reservation on each of the links of the 

path). 

■ The tables update reflects the changes in the availability of the network resources. The 
information is sent to every node in the network. 

The Label Swapping technique requires that the connection tables be set up and maintained dynam- 
20 ically. That means that when a new connection is established or an old one is terminated the tables are 
updated (the database of network topology can of course be maintained quite separately). This is possible if 
the connection set up is relatively infrequent and is not too time critical. This restriction makes datagram 
transport quite inefficient. However, connections that require very short packets, like real-time voice 
connections, can be effectively supported by this technique, because of the low packet overhead. AH is 
25 needed is a field to specify which connection is to be used for the packet. 

Key requirements 

The Distributed Routing mechanism in large and high speed packet switching networks supporting both 
30 connection oriented and connectionless routing modes implies some requirements in terms of performance 
and resource consumption which can be summarized as follows : 

• the source node (or the node providing the route calculation for the source node) must be able to 
decide where to route an incoming packet in a very short portion of time (the computation must be 
sufficiently rapid to compute an optimum path for each connection request) 

35 © the switching time in the intermediate nodes must be minimized, (minimum processing time) 

• the network resources along the selected path must be optimized according to the customer 
criterions. 

• Control messages must be as much as possible limited not to overload the network. 
40 Path Selection Criterions 

Bellman-Ford Algorithm 

There are several possible adaptive routing algorithms to compute an optimal path between nodes in a 
4b packet network. The Bellman-Ford algorithm described by D. Bertsekas and R. Gallager in Data 
Networks - Prentice- Hall 1987 Englewood Cliffs, New Jersey - is one of the most currently used in 
fast packet packet switching networks. The objective of the algorithm is to find a path joining two nodes with 
the minimum length, the length being defined to reflect the congestion of the link. The algorithm starts from 
the source node and first find the shortest path lengths subject to the constraint that the paths contain at 
so most one link. Then, it find the shortest path lengths with a constraint of paths of at most two links, and so 
forth. 
Let 

© N the number of nodes (labeled 1,2, .... N). 
© M the number of unidirectional links. 
55 It is assumed that there is at most one unidirectional link going from one node to another, and so 

a link can be identified by its end points. 

• h the number of hops, 
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• D (i,h) the shortest (<h) path length from source node (1) to node (i). 

By convention D (l,h) = 0 for all h. 

• d/; the length of the link connecting node (i) to node G). 

By convention d/j = ~ if nodes (i) is not connected to node (j). 
5 Initially O(/,0) = <» for all / * 1 

For each successive 0 £ h , 

D(i,h + 1) = fn\n]lD(J,h) + dp] , j = 1 N for all i * 1 

w A path can contain at most N-1 links. In the worst case, the algorithm must be iterated N-1 times, each 
iteration must be done for N-1 nodes, and, for each node, the minimization must be taken over no more 
than N-1 alternatives. Thus the amount of computation grows at worst as /v 3 . 

Let D(i) be the shortest path length from node (1) to (i) t with D(1) = 0, then the equation converges with 
h = N-1 and can be written : 

75 

D(i) = min,[D(/") + d p ] t for all / * 1 
D<1) = 0 

This is called Bellman's equation and expresses that the shortest path length from node (1) to (i) is 
20 the sum of the path length to the node before (i) (on the shortest path) plus the distance on the final link of 
the path. 

Modified Bellman-Ford Algorithm 

25 As described with the Bellman-Ford algorithm, one of the major criterion for selecting paths between 
nodes in packet networks is the minimum path length. The path length depends of the customer criterions. 
In most of the cases, the length is a function of the overall transmission delay imposed by the path between 
the two end nodes. In most high speed networks, the delay (path length) is not a major consideration since 
the worst-case delay through such networks is nearly always acceptable. The hop count, however, is a 

30 direct measure of the amount of resources required to implement a given path and hence is of considerable 
importance in selecting paths. The hop count is defined as the number of links used to construct the path 
between two nodes. A selected path need not be a minimum hop count path since congestion on the 
network links may force the choice of a larger hop count path. However, such longer alternate paths cannot 
be allowed to grow without limit since inordinate amounts of network resources might be committed to one 

35 path, resulting in further congestion for other paths and forcing yet longer hop count paths to be selected 
for yet other connections. The long term network throughput could thereby be adversely affected. The 
problem, then, is to select a path between an origin node and a destination node which has a minimum hop 
count, a minimum path length, which does not utilize an inordinate amount of network resources. 

The goal of the Modified Bellman-Ford algorithm is to find a path, between a given source and 

40 destination node pair, with a minimum number of links connecting the source and the destination node 
and with a minimum path length. The algorithm starts from the source node and progresses by increasing 
the hop count (the number of links) until it finds a feasible path. At each hop count h, the algorithm finds 
the smallest path length from the source node to each intermediate node with exactly h links. 
Let D(i,h) the smallest path length from the source node to the node (i) with exactly h hops : 

45 

D(i,h) = min,{0(/,/> - 1) + tf /f ] , j = 1.....N for all /* 1 

where, by convention tf /7 = » if link (ji) does not exists (which include the case i=j). 

Let s, the source node and d, the destination node, the algorithm stops at hop count n*. D(d,h*) being 
50 the smallest path length among all the minimum hop feasible paths. 

The difference between the Bellman-Ford and the Modified Bellman-Ford algorithms is that in the 
Bellman-Ford keeps going until it finds a path with the smallest path length (It stops when the smallest path 
length to each intermediate node cannot be further reduced or when all hop counts have been tried). 

55 European Patent Application 93480030.1 

European Patent Application 93480030.1 entitled - Methods and Apparatus for Optimum Path 
Selection in Packet Transmission Networks discloses a method to select optimum paths between origin 
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and destination nodes by means of a improvement of the Modified Bellman-Ford algorithm. The method 
defines "principal paths" between any given origin-destination pair. A principal path is defined as a feasible 
minimum-hop count path and principal links are defined as links in a principal path. All other links are 
defined as secondary links. Secondary paths are paths including at least one secondary link and including 
5 more than the minimum-hop count. 

• A principal path is accepted as a route if none of its principal links is saturated, that means exceeds 
its preassigned traffic load. 

• A secondary path, however, is accepted as a route only if none of its principal links, if any, is 
saturated and if the load levels on its secondary links are below a preselected threshold (typically 

10 lower than that for links designated as principal). If this load threshold is exceeded on any of the 

secondary links, the secondary path is rejected as a route. 
One advantage of the path selection technique of this invention is that a maximum path length 
constraint can be imposed on the path selection process. That is, feasible paths can be tested to determine 
if the path length constraint has been exceeded and rejected if the constraint is exceeded. Such constraints 
75 can be used to prohibit inordinate resource consumption in implementing a route and can also be used to 
impose specific grade of service requirements such as avoidance of low speed links. For this reason, the 
path length constraints must typically be specified for each connection request, and the principal links 
determined separately for each connection request. 

The algorithm is invoked with some of the following parameters : 
20 • the source node address, 

9 the destination node address, 

• the quality of service required for the connection. For example : 

b maximum call set up delay (very important parameter for connections serviced in real time). 

■ maximum end to end transit delay, 

25 ■ maximum information loss, error probability, 

■ ... 

The algorithm uses in the source node (or access node) a local copy of the network topology to 
determine the minimum hop and path length to the destination node. 

The route selection technique of European Patent Application 93480030.1 involves two phases. In the 
30 first phase, the principal links are identified for the requested connection. If no maximum length constraint is 
imposed, the principal links between any two nodes of the network can be precomputed and stored for use 
in the second phase of the algorithm. If a maximum length constraint is imposed, the principal links must be 
calculated for each new connection request, comparing each link length with the constraint, or the constraint 
decreased by the previously accepted principal link lengths. 
35 This route determination technique has the advantages of producing optimum paths between arbitrary 

nodes of a packet switching system, taking into account not only the hop count and the path length, but 
also imposing a maximum ceiling on the path length. 

But the problem is to compute the paths sufficiently rapidly so that an optimum route can be selected 
for each connection request. 
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Summary of the invention 



In accordance with the illustrative embodiment of the present invention, optimum rouiing paths between 
origin and destination nodes in a packet network are selected more efficiently by reducing the total number 
4b of links potentially explored by the Modified Bellman-Ford Algorithm described in the European Patent 
Application 93480030.1 . The path selection technique of the present invention involves two phases, the first 
phase for principal links identification, and the second phase for selection of the best point-to-point path in 
the network. 

More particularly, the algorithm of the present invention limits the screening of the network links in the 
50 second phase to the principal links and excludes the secondary links. The exploration of a much smaller 
number of links has the advantage to considerably reduce the computation time required for the path 
selection. The fact the number of principal links is generally small compared with the total number of links 
potentially explored, allows to limit the additional processing time necessary in case of unsuccessful 
attempt. 

55 In summary, the present invention discloses a system and a method for determining an optimal routing 

path between an originating and a destination node in a network. Said method involves the steps of : 

• storing and updating the network configuration, 

• in a first phase : 
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■ identifying principal paths including minima! hop count and minima! transmission delay between 
said originating node and said destination node in said network, 

■ identifying principal and secondary links, 

• determining, in a second phase and in response to said step of identifying principal paths and links, 
5 an optimal path between said originating and destination nodes, 

and is characterized in that it further comprises the steps of : 

• determining, in said second phase, an optimal path using only principal links, 

• determining, when the destination node is not reached using said principal links, an optimal path using 
principal and secondary links. 

to Said step of determining an optimal path on principal and secondary links, is using link utilization data 
previously computed on principal links by said step of determining an optima! path on said principal links. 

Description of the drawings 

is Figure 1 shows the processing times (or number of instructions per second) required in function of the 
different line throughputs supported by the high speed networks. 

Figure 2 shows a typical model of high speed packet switching network including the access and transit 
nodes claimed in the present invention. 

Figure 3 describes a high speed Routing Point according to the present invention. 
20 Figure 4 shows a portion of the Topology Database in each Routing Point. 

Figure 5 shows a general flow chart of the path determination procedure according to the present 
invention. 

Figure 6 shows a detailed flow chart of the accelerated option of Phase 2 according to the present 
invention. 

25 Figure 7 shows a detailed flow chart of the conventional option of Phase 2 according to the present 
invention. 

Figure 8 shows a more detailed flow chart of Routine A1 of the Phase 2 accelerated search algorithm 
according to the present invention. 

Figure 9 shows a more detailed flow chart of Routine A2 of the Phase 2 conventional search algorithm 
30 according to the present invention. 

Figure 10 shows an example of high speed network. 

Figure 11 illustrates the exploration of the network links for a path search between Los Angeles and 
Milano in an accelerated path search according to the present invention. 

Figure 12 illustrates the exploration of the network links for a path search between Los Angeles and 
35 Milano in a conventional path search according to the present invention. 

Description of the preferred embodiment of the invention 

As illustrated in Figure 2, a typical model of communication system is made of several user networks 
40 (212) communicating through a high performance network (200) using private lines, carrier provided 
services, or public data networks. Each user network can be described as a set of communication 
processors and links (211) interconnecting large computers used as enterprise servers (213), user groups 
using workstations or personnel computers attached on LAN (Local Area Networks 214), applications 
servers (215), PBX (Private Branch exchange 216) or video servers (217). These user networks, dispersed 
45 in different establishments, need to be interconnected through wide area transport facilities and different 
approaches can be used for organizing the data transfer. Some architectures involve the checking for data 
integrity at each network node, thus slowing down the transmission. Others are essentially looking for a high 
speed data transfer and to that end the transmission, routing and switching techniques within the nodes are 
optimized to process the flowing packets towards their final destination at the highest possible rate. The 
50 present invention belongs essentially to the latter category and more particularly to the fast packet switching 
network architecture detailed in the following paragraphs. 

High speed packet switching networks 

55 The general view in Figure 2 shows a fast packet switching transmission system comprising eight 
nodes (201 to 208) each node being interconnected by means of high speed communication lines called 
Trunks (209). The access (210) to the high speed network by the users is realized through Access Nodes 
(202 to 205) located at the periphery. These Access Nodes comprise one or more Ports, each one 
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providing an access point for attaching external devices supporting standard interfaces to the network and 
performing the conversions required to transport the users data flow across the network from and to other 
externa! devices. As example, the Access Node 202 interfaces respectively a Private Branch exchange 
(PBX), an application server and a hub through three Ports and communicates through the network by 
5 means of the adjacent Transit Nodes 201, 208 and 205. 

Switching Nodes 

Each network node (201 to 208) includes a Routing Point where the incoming data packets are 
w selectively routed on the outgoing Trunks towards the neighboring Transit Nodes. Such routing decisions 
are made according to the information contained in the header of the data packets. In addition to the basic 
packet routing function, the network nodes also provide ancillary services such as : 

• the determination of routing paths for packets originated in the node, 

• directory services like retrieving and updating information about network users and resources, 

75 • the maintaining of a consistent view of the physical network topology, including link utilization 
information, and 

• the reservation of resources at access points of the network. 

Each Port is connected to a plurality of user processing equipments, each user equipment comprising 
either a source of digital data to be transmitted to another user system, or a data sink for consuming digital 
20 data received from another user system, or, typically, both. The interpretation of the users protocols, the 
translation of the users data into packets formatted appropriately for their transmission on the packet 
network (200) and the generation of a header to route these packets are executed by an Access Agent 
running in the Port. This header is made of Control and Routing Fields. 

• The Routing Fields contain all the information necessary to route the packet through the network (200) 
25 to the destination node to which it is addressed. 

• The Control Fields include, among other things, an encoded identification of the protocol to be used in 
interpreting the Routing Field (Source Routing, Label Swapping ). 

Routing Points 

30 

Figure 3 shows a general block diagram of a typical Routing Point (300) such as it can be found in the 
network nodes (201 to 208) illustrated in Figure 2. A Routing Point comprises a high speed packet Switch 

(302) onto which packets arriving at the Routing Point are entered. Such packets are received : 
© from other nodes over high speed transmission links (303) via Trunk Adapters (304). 

35 © from users via application adapters called Ports (301). 

Using information in the packet header, the adapters (304, 301) determine which packets are to be 
routed by means of the Switch (302) towards a local user network (307) or towards a transmission link 

(303) leaving the node. The adapters (301 and 304) include queuing circuits for queuing packets prior to or 
subsequent to their launch on the Switch (302). 

40 The Route Controller (305) calculates the optimum routes through the network (200) so as to satisfy a 
given set of quality of service specified by the user and to minimize the amount of network resources used 
to complete the communication path. Then, it builds the header of the packets generated in the Routing 
Point. The optimization criterion includes the number of intermediate nodes, the characteristics of the 
connection request, the capabilities and the utilisation of the Trunks in the path ... All the information 

45 necessary for the routing, about the nodes and transmission links connected to the nodes, are contained in 
a Network Topology Database (306). Under steady state conditions, every Routing Point has the same view 
of the network. The network topology information is updated when new links are activated, new nodes 
added to the network, when links or nodes are dropped or when link loads change significantly. Such 
information is originated at the network node to which the resources are attached and is exchanged by 

so means of control messages with all other Route Controllers to provide the up-to-date topological information 
needed for route calculation (such database updates are carried on packets very similar to the data packets 
exchanged between end users of the network). The fact that the network topology is kept current in every 
node through continuous updates allows dynamic network reconfigurations without disrupting end users 
logical connections (sessions). 

55 The incoming transmission links to the packet Routing Point may comprise links from external devices 

in the local user networks (210) or links (Trunks) from adjacent network nodes (209). In any case, the 
Routing Point operates in the same manner to receive each data packet and forward it on to another 
Routing Point as dictated by the information in the packet header. The fast packet switching network 
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operates to enable a communication between any two end user applications without dedicating any 
transmission or node facilities to that communication path except for the duration of a single packet. In this 
way, the utilization of the communication facilities of the packet network is optimized to carry significantly 
more traffic than would be possible with dedicated transmission links for each communication path. 

5 

Link Characteristics 
Topology Database 

w Figure 4 shows, in tabular form, a portion of the information stored in the Topology Database 306. The 
different characteristics of each link in the network are listed in the database. For the present invention, only 
a few of these characteristics will be discussed. 

Load Threshold 

15 

As might be expected, one of the critical characteristics of the transmission links is the Load Threshold 
available. Moreover, it is well known that such transmission facilities can only be loaded up to a fraction of 
their theoretical maximum load (bandwidth) if reasonable transmission properties have to be maintained. 
The Load Threshold of such a transmission facility can be represented by the quantity C kt (the effective 
20 load capability of the transmission link between nodes (k) and (I)). Two different Load Thresholds, L(P) and 
L(S), are defined for each transmission links, depending on whether the link is selected as a principal link in 
a route or as a secondary link in the route. 

Principal and Secondary links 

25 

A principal link is defined as a leg of a principal path where a principal path is a feasible minimum hop 
count path between the originating node and the destination node. The hop count h is simply the number of 
transmission links in the path. AH other links are defined to be secondary links. Any non-minimum hop 
count path between the originating node and the destination node is called a secondary path and it always 
30 includes at least one secondary link. 

A principal path is preferred over a secondary path in determining optimum routes between nodes. The 
computation time necessary is also significantly shorter for a principal path than for a secondary path. 

If, however, a principal path is not available due to its already being fully loaded, a secondary path can 
be chosen. In order to discriminate against such a secondary path, a Load Threshold C WrS is defined for 
35 each secondary link which is less than the corresponding principal Load Threshold C MtP for that same link 
(C MtP £ Cfr/. s ). That is the reason why the table of Figure 4 includes two different Load Thresholds for each 
transmission link, one to be used if the link is a principal link in a route being calculated and the other to be 
used in the link if a secondary link in the route being calculated. 

40 Total Allocated Load 

The table includes the Total Allocated Load, T(AL), for each link. The value 6 M represents the total load 
(or bandwidth) which has already been allocated for the transmission link kl (transmission link between 
nodes (k) and (1)) due to previously calculated routes. If the difference between this already allocated load 
45 G M and the total available principal or secondary load of the channel C M (C k i t p or Cm,s depending on the 
whether the link is a principal link or a secondary link) is not sufficient to carry the new connection, then the 
link cannot be selected. 

As described in European Patent Application 93480030.1 the present invention uses also a maximum 
delay defined as P T and optionally some "Quality of Service" parameters (QOS). Such QOS parameters 
50 may include, for example, a particular security level, a packet size or a minimum probability of overflow ... 

Route Determination 

Route request 

55 

Each request for a route determination includes the following input parameters: 

• Source Node (i) 

• Destination Node (j) 

9 
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• Required Bandwidth (c) 

• Maximum Path Length Threshold (Pr) 

• Quality of Service Parameters (QOS) (Optional) 

The requested maximum path transmission delay is generally taken as Path Length Threshold (P T ). Using 
5 these parameters, a path is determined by first searching through all links to determine minimum hop count 
path that satisfy the maximum path length constraint P T and then backtracking to derive a list of principal 
links. This search is supplemented by accumulating the link delays d k \ for each path. Once the destination 
node is reached, minimum hop count principal paths are backtracked to create a list of principal links. This 
principal link list is used in the second phase of the algorithm to determine the optimum path from the 
io source to the destination node. This specific procedure for determining paths through a packet communica- 
tions system will be described with reference to Figures 5, 6, 7, 8 and 9. 

Path Determination Procedure 

75 Figure 5 shows a general flow chart of the path determination procedure according to the present 

invention. 

1. Data Input (501) 

Starting at 500, step 501 first specifies the inputs required to calculate an optimum route. As noted 
above, these input parameters include the originating node (i), the destination node (j), * ne requested 
20 connection bandwidth (c) and the maximum Path Length Threshold P T (and optionally a group of Quality 
Of Service (QOS) parameters). 

2. Phase 0 (502) : Bandwidth Requirements 

The list of links in the network is pruned by removing all links which do not meet the required 
bandwidth c (c £ C kf ) and the Quality Of Service (QOS) parameters. 
25 3. Phase 1 (503) : Principal and Secondary Links Search 

With this decimated list of transmission links, the function of Phase 1 (503) is to identify the principal 
links. In determinating the lengths of the transmission links Zd kh the process assumes that the utilization 
of each link is zero 

30 (C„ = 0), 

which means that the entire bandwidth of the link is available. The process used to search for principal 
paths is the Modified Bellman-Ford Algorithm described in Patent Application 93480030.1. 
35 4. Phase 2 (504) : Optimum Path Computation 

Once the principal paths have been identified (503), the function of Phase 2 (504) is to identify the 
optimum path, using the principal paths from Phase 1 (503), and the current utilization data (allocated 
bandwidth C kl ). It exists two different options for Phase 2, an Accelerated Version and a Conventional 
Version : 

40 © The Conventional Version is similar to Phase 2 described in Patent Application 93480030.1 , 

• The Accelerated Version, object of the present invention, represents a significant improvement in 
the process of the path selection by limiting the screening of the network to the principal links. This 
version will be described in detail hereafter. 
5. Acceptable Path Determination (505) 
45 As noted in 505, the output of Phase 2 (504) is an acceptable minimum hop count path from the 

originating node (i) to the destination node (j) if it has the minimum possible hop count and if its path 
length is less than the input maximum of P T (Zd k , .< P T ). If no such path exists, a failure signal is returned. 
The process ends in 506. 

Note : No detailed flow chart of Phase 1 is shown due to the fact that this phase is strictly identical to 
50 the one described in Figure 6 of Patent Application 93480030.1 

Phase 2 

1 . Accelerated Version 

55 Figure 6 shows a more detailed flow chart of the Accelerated Version of Phase 2 where the optimum 

path is computed. Starting in 600, Routine A1 (601), similar to Routine A in Phase 1, is executed. 
Routine A1 uses the same modified Bellman-Ford Algorithm to determine the feasibility and the link 
length for each possible link in the ultimate path. The main difference resides in the fact that onfy 

10 
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principal links are considered in the links exploration part of the algorithm. Principal links are accepted as 
feasible only at the condition that the load capacity is available for the new connection, i.e., 

civ 

5 

does not exceed the principal link load threshold C^p. Secondary links are not considered. If the 
destination node is not reached at the end of Routine A1 the process switches to the conventional 
method detailed in Figure 7. If the destination node is reached (602), the list of feasible links are 

io backtracked (603) through using the hop count and the path lengths to find the shortest principal path, all 
the principal paths having the same minimum hop count. The process of Figure 6 ends in 604. 
2. Conventional Version 

Figure 7 shows a more detailed flow chart of Phase 2 in which the optimum path is computed. The 
Phase 2, according to the present invention includes an Accelerated (701, 704) and a Conventional (703, 

75 704) Version. The Conventional Version is the process used when Routine A1 of the accelerated option 
does not succeed in reaching the destination node of the desired path. Phase 2 starts in 700 with the 
accelerated version. If the destination node is not reached at the end of the Routine A1 (701) (decision 
point 702) after all principal links have been searched in order to find a feasible principal path, Routine 
A2 (703) is executed. Routine A2 operates according to the conventional method described in European 

20 Patent Application 93480030.1. It considers both principal and secondary links : secondary links are 
accepted as feasible provided that adding the new connection does not result in exceeding the 
secondary link load threshold C W(S - However routine A2 benefits from all the checkings and 
computations related to 

previously done for the principal links by Routine A1 in 701. That is the reason why the chaining of 
the two Routines, A1 (701) and A2 (703), does not sensibly degrade the Phase 2 of the present 
30 invention compared with the Phase 2 described in European Patent Application 93480030.1. In step 704, 
the list of feasible links are backtracked through using the hop count and the path lengths to find the 
shortest path with the minimum hop count. The Phase 2 ends in 705 

Note : 

35 

• The modified Bellman-Ford Algorithm used in Routine A of Phase 1 , Routine A1 of the Accelerated 
Phase 2, and Routine A2 of the Conventional Phase 2 is the same as the one described in Figure 8 of 
European Patent Application 93480030.1. 

• The Backtracking procedure used in Routine B of Phase 1 and Routine B of Accelerated and 
40 Conventional Phase 2 of the present invention is the same as the one described in Figure 9 of 

European Patent Application 93480030.1. 

Search Algorithm 

45 1. Accelerated Version (Routine A1) 

Figure 8 shows a detailed flow chart of the Modified Bellman-Ford Algorithm used to perform the 
accelerated search for an optimum path. Starting at 800, step 801 first sets the next node to the origin 
node (i). in 802, the data for the next node is retrieved from the Topology Database (306). In 803, the 
data for the next link leaving that node is obtained from the same Topology Database (306). Decision 
so point 804 determines whether that link is principal or not : 
• If the link is principal, decision point 805 is entered : 
■ The accumulated load 

civ 

iscomputedinstep812.:IL Then, 
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■J.Cif 

is compared to the link principal threshold C k i,p : 
5 a If the accumulated load is equal to or less than the principal threshold, 

{CP < C klP ), 

io the decision point 806 tests the accumulated path length or delay. 

a If the accumulated load is greater than the principal threshold as determined by decision 
point 805 



75 



50 



(ClV>C kt . P ), 



the next link is obtained in 808. 

• If it is determined in decision point 804 that the link is not a principal link, the link is not considered 
and the next link is obtained in 808. 

20 In decision point 806, the accumulated path length up to this point Zd kt is compared to the maximum 

path length P T : 

• If the accumulated path length Zd M is less than P Tt the hop count h k and the accumulated path 
length d k , are saved in a list (807), the node reached is also saved in order to proceed with the 
iteration at the next hop if necessary. 

25 © If the accumulated path length Zd kl is equal to or greater than P T , step 807 is bypassed and the 

data for this link is not added to the list. 
In either case, decision point 808 is then entered to determine if there are any more links exiting 
from this node. If so. step 803 is activated to get the next link and continue the process. If there are no 
more links exiting from this node, decision point 809 determines if the node is the destination node G). If 
30 so, the process is complete and terminates in 811. If this node is not the destination node (j), decision 
box 810 determines if there are any more nodes to be screened. If so, step 802 gets the next node and 
continue the process. If there are no more nodes to be screened, then the accelerated search has failed 
and the conventional search described in Figure 9 is started in 900. 

When the procedure of Figure 8 is complete, and destination node (j) has been reached, a list of the 
35 minimum hop counts h k and the path lengths d k! is available. As discussed above, Routine B then 
backtracks through this list to identify the path with the minimum path delay as well as the minimum hop 
count. This is the optimum path to be used in sending the packets involved in the connection through the 
system of Figure 2. 

Note: When the Modified Bellman-Ford Algorithm is used to identify the principal paths, the same 
40 flow chart as shown in Figure 10 of Patent Application 93480030.1 is used. 
2. Conventional Version (Routine A2) 

Figure 9 shows a detailed flow chart of the Modified Bellman-Ford Algorithm used to perform the 
conventional search for an optimum path. Starting in 900, step 901 first sets the next node io the origin 
node (i). In 902, the data for the next node is retrieved from the Topology Database (306). In 903, the 
45 data for the next link leaving that node is obtained from the same Topology Database. Decision point 904 
determines whether that link is principal or not : 

• If the link is principal, decision point 905 compares the accumulated load 



with the link principal threshold C MtP This accumulated load has been computed previously 
during the accelerated search algorithm and so can be reused here. 

a If the accumulated load is equal to or less than the principal threshold, decision point 907 tests 
55 the accumulated path delay. 

■ If the accumulated load is greater than the principal threshold, as determined by decision point 
905, the next link is obtained in 909. 
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= = > Pseudocode for principal link handling: 
IF {kj) e PL r CIV available from routine A1 V 
IF CW < C A , P 
IF £cf w < P T 

.... r Continue phase A2 execution V 

If it is determined in decision point 904 that the link is a secondary link, 

■ the accumulated load 

civ 

is computed in step 913, and 

■ then, decision point 906 compares the accumulated load 

to the link secondary threshold C w ,s- 

a If the accumulated load is equal to or less than the secondary threshold, decision point tests 

the accumulated path delay. 
a If the accumulated load is greater than the secondary threshold, as determined by decision 

point 906. the next link is obtained in 909. 

= = > Pseudocode for secondary link handling: 
IF (kJ)iPL r C[? must be computed 7 

A A 

Compute CiV /* Complex computation involving CJ[)> 
and c */ 

IF CiV < C w . s 
IF < P r 



.... /* Continue phase A2 execution */ 



In decision point 907, the accumulated path length up to this point is compared to the 
maximum path length P T . 
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• If the accumulated path length is less than P T , the hop count h k and the accumulated path length 
d k , are saved in a list in step 908. 

• If the accumulated path length is equal to or greater than P T , step 808 is bypassed and the data for 
this link is not added to the list. 

5 In either case, decision point 909 is then entered to determine if there are any more links exiting from 

this node. If so, step 903 gets the next link and continues the process. If there are no more links exiting 
from this node, decision point 910 is entered to determine if the node is the destination node (j). W so, the 
process is complete and terminates in 912. If this node is not the destination node (j). decision point 911 
then determines if there are any more nodes to be screened. If so, step 902 gets the next node and 

10 continues the process. If there are no more nodes to be screened, then no path is feasible, the process 
terminates in 912. 

When the procedure of Figure 9 is complete, a list of the minimum hop counts h k and the path lengths 
d k , is available. As discussed above, Routine B then backtracks through this list to identify the path with the 
minimum path delay as well as the minimum hop count. This is the optimum path to be used in sending the 
75 packets involved in the connection through the system of Figure 2. 

Example of implementation 

Path Search in a Typical Network 

20 

Figure 10 shows a typical network used to illustrate the improvements provided by the present 
invention. It is a packet switched network comprising 33 nodes and 126 unidirectional high speed 
transmission links (63 trunks) of various capacity : T1 (1.5 Mbps), T3 (45 Mbps), E1 (2 Mbps), E3 (34 
Mbos). OC3 , STM1 (155 Mbps)... The average connectivity is two trunks per node with a minimum of one 

25 (Os»o, Edinburgh, Dublin, San Jose, Boston, Warsaw) and a maximum of eleven (Paris). The object of the 
present invention is to reduce the number of links potentially explored in searching for the optimum path 
between a source and a destination node. In our example, the source is Los Angeles (USA) and the 
destination is Milano (Italy). The Phase 1 of the route determination procedure identifies four principal paths 
with a minimal hop count of three : 

30 • Los Angeles - London - Zurich - Milano 

• Los Angeles - London - Paris - Milano 

• Los Angeles - Raleigh - Nice - Milano 

• Los Angeles - New York - Paris - Milano 

Once Phase 1 is successfully achieved, Phase 2 is executed to determine an optimum path : 
35 * Accelerated Version 

Figure 1 1 shows the number of links explored by the Modified Bellman-Ford Algorithm in Routine 
A1 object of the present invention. Only the principal links are considered to determine the path 
length and feasibility. In our example, the network is reduced to 10 links : Los Angeles - London, Los 
Angeles - Raleigh, Los Angeles - New York, Raleigh - Nice, Nice - Milano, London - Zurich, London - 
40 Paris. Paris - Milano, Zurich - Milano, New York - Paris. 

• Conventional Version 

Figure 12 shows the number of links explored by the Modified Bellman-Ford Algorithm used in 
Routine A of the the conventional Phase 2 described in European Patent Application 93480030.1. The 
search is not only limited to principal links but includes also secondary links. For example, Moscow 
45 can be reached in three hops. The secondary links New York - Berlin and Berlin - Moscow are visited 

by the algorithm in its search for the optimum path. In our case, 54 links have been explored which 
represents 80% of the network. 

Performances 

50 

To quantify the improvement resulting from the the new Path Selection procedure compared with the 
original version, a simulation has been done to estimate the performances of the path selection code 
running under a A!X Rise System/6000 workstation (compiled with XLC). An AIX tool providing, in output, 
the list of all instructions executed during the program and their usage frequency has been used. 
55 The simulated network is the one described in Figure 10. It comprises 33 nodes and 126 unidirectional 
links (63 trunks). Three tests have been run, first with the specifications detailed in European Patent 
Application 93480030.1 and secondly with the route determination procedure object of the present 
invention. The results of the computations are compared in the table hereunder : the gain of performance in 
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term of executed instructions is about 15%. 
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Test 


hops 


Visited links in 
Phase 1 


Executed instructions 


Conventional 


Accelerated 


Gain 


1 


2 


22 


84.005 


73.604 


13% 


2 


3 


54 


189.331 


156.955 


17% 


3 


5 


63 


241.341 


199.723 


17% 



The performance gain can reach 50 % and more especially for longer paths and also when processors 
with rather poor computation capability are used, for example processors without Floating-Point capability. 



75 Note : 



20 



These results take into account the two phases of the path selection procedure : Phase 1 remains 
unchanged and Phase 2 is updated in its new version according to the present invention. 
The second pass having more floating point calculation compared with the first one, the gain would be 
larger with a hardware platform devoid of Floating Point Unit. For example, with a 960CF Intel 
processor (no Floating Point Unit), the gain is estimated to 50% for a average 4 hops path. 



Appendix 



25 Definitions 



30 



35 



40 



N is the total number of nodes in the network. 

h is the iteration index of the algorithm, equal to the hop count. 

h* is the hop count of the minimum hop path from the source node to the destination node satisfying 
the path length constraint (n* = 0 if the algorithm does not find a feasible path). 
h k is the number of hops from the source node to node (k). 

P T is the maximum Path Length Threshold between the origin (i) and the destination (j) nodes 
(maximum delay tolerated by the requesting connection). 

d M is the length (or delay) of the link (if any) between nodes (k) and (I). d kl = «> if no link exists 
between node k and I, or if k = I. 

C M is the effective load (or bandwidth) capability of the link between node (k) and node (I) (Load 
Threshold) 

■ C MfP is the Load Threshold L(P) of the link (kl) as principal link in the route. 

■ Cm.s is the Load Threshold L(S) of the link (kl) as secondary link in the route. 

C k , is the Total Allocated Load T(AL) for the link between modes (k) and (I) (total load which has 
already been allocated for this link due to previously calculated routes). 
Current allocated load on link (kl) : 



45 



CJJ> 



50 



is the allocated load not taking the requesting connection into account. 



civ 



is the allocated load after the requesting connection. 
55 • D(l,h) is the smallest path length (delay) from the source node to the node (I) with exactly h hops ( = 
oo if no such path exists). 
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Claims 

1. A network access node (300) in a packet switching communication network (200) comprising a plurality 
of nodes (201. .208) interconnected with transmission links (209), said node including : 

5 • means for receiving and transmitting data packets (301 , 302, 304), 

• means for storing and updating the network configuration (306), 

• means, in a first phase (503), for : 

■ identifying principal paths including minimal hop count and minimal transmission delay Zd k i 
between an originating node and a destination node in said network, 

w ■ identifying principal and secondary links, 

© means, responsive to said means for identifying principal paths and links, for determining, in a 
second phase (504), an optimal path between said originating and destination nodes, 
and characterized in that said means for determining, in said second second phase (504), an 
optimal path comprises : 
75 • means for determining an optimal path using only principal links (701, 704). 

2. A network access node (300) according to claim 1 wherein said means for determining, in said second 
phase, an optimal path comprises a further means 

for determining an optimal path using principal and secondary links (703, 704) when the destination 
20 node is not reached (702) using only said principal links. 

3. A network access node (300) according to claim 2 wherein : 

said means for determining an optimal path on principal and secondary links, is using link utilization 
data previously computed on principal links by said means for determining an optimal path on said 
25 principal links. 

4. A network access node (300) according to anyone of claims 1 to 3 comprising 

means for limiting the transmission delay in said optimal path to a preselected threshold Pt<505). 

30 5. A network access node (300) according to anyone of claims 1 to 4 wherein 

said means for determining an optimal path between said originating and destination nodes 
comprises a Modified Bellman-Ford algorithm (701, 703). 

6. A method in an access node (300) for determining an optimal routing path between an originating node 
35 and a destination node in a packet switching communication network (200) comprising a plurality of 

nodes (201 ..208) interconnected with transmission links (209), said method involving the steps of : 

• storing and updating the network configuration (306), 

• in a first phase (503) : 

■ identifying principal paths including minimal hop count and minimal transmission delay Zd kl 
40 between said originating node and said destination node in said network, 

h identifying principal and secondary links, 

• determining, in a second phase (504) and in response to said step of identifying principal paths 
and links, an optimal path between said originating and destination nodes, 

and characterized in that said second phase (504) for determining an optimal path comprises the 
45 step of : 

© determining an optimal path using only principal links (701 , 704), and 

7. The method according to claim 6 wherein said second phase (504) for determining an optimal path 
comprises the further step of : 

so determining, when the destination node is not reached (702) using only said principal links, an 

optimal path using principal and secondary links (703, 704). 

8. The method according to claim 7 wherein 

said step of determining an optimal path on principal and secondary links, is using link utilization 
55 data previously computed on principal links by said step of determining an optimal path, on said 

principal links. 
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9. A method according to anyone of claims 6 to 8 comprising : 

the step of limiting the transmission delay in said optima! path to a preselected threshold P T (505). 

10. A method according to anyone of claims 6 to 9 wherein 

5 said step of determining an optimal path between said originating and destination nodes comprise 

a Modified Bellman-Ford algorithm. 
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